Path-integral formulation of stochastic processes for exclusive particle systems 
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We present a systematic formalism to derive a path-integral formulation for hard-core particle 
systems far from equilibrium. Writing the master equation for a stochastic process of the system 
in terms of the annihilation and creation operators with mixed commutation relations, we find the 
Kramers- Moyal coefficients for the corresponding Fokker-Planck equation (FPE), and the stochastic 
differential equation (SDE) is derived by connecting these coefficients in the FPE to those in the 
SDE. Finally, the SDE is mapped onto a field theory using the path integral, giving the field-theoretic 
action, which may be analyzed by the renormalization group method. We apply this formalism to a 
two-species reaction-diffusion system with drift, finding a universal decay expoent for the long-time 
behavior of the average concentration of particles in arbitrary dimension. 
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In recent years, nonequilibrium phenomena such as 
nonequilibrium phase transitions, bifurcations, and syn- 
ergetics have attracted much attention not only be- 
cause of their connections to a variety of important phys- 
ical problems (pattern formation, morphogenesis, self- 
organization, etc.), but also because of the analytic chal- 
lenge due to lack of a general formalism for nonequilib- 
rium systems, in contrast to equilibrium statistical me- 
chanics, which has well-established concepts and tools. 
In pursuit of a general formalism, statistical physicists 
have investigated nonequilibrium phase transitions in lat- 
tice models over the last decade As lattice models 
have played a central role in equilibrium statistical me- 
chanics, they will also be important in nonequilibrium 
statistical mechanics. In particular, theoretical analysis 
of reaction-diffusion systems where both diffusion and 
reaction take place on the lattice is relevant to the un- 
derstanding of a wide class of nonequilibrium phenom- 
ena in nature It has long been recognized that the 
mean-field rate equations are not applicable to reaction- 
diffusion systems in low dimensions. After Doi and others 
introduced the field-theoretic method using the bosonic 
coherent state path integral |^ , Lee and Cardy using the 
renormalization group (RG) approach have improved on 
this method |^,^ in the description of the anomalous ki- 
netics in these systems. Assuming the systems are in the 
low density regime, Lee and Cardy rewrite the master 
equation for the Markov process as the bosonic Hamil- 
tonian . The Hamiltonian in turn can be mapped onto 
field theory and analyzed by the renormalization group 
method in arbitrary dimensions. For simple models such 
as A + A ^ % and A + B 0, this bosonic field-thoeretic 
method provided the correct time dependence for the 
density decay in low dimensions ■ 

Despite the successes achieved by the bosonic field the- 
ory for reaction-diffusion systems, there are still m any 
open problems. Driven reaction-diffusion systems P,p^, 



multi-species adsorption models , and epidemic mod- 
els are some examples to which the bosonic field theory 
cannot be applied since the steady states of these systems 
cannot be assumed to be in a low density regime. In these 
systems, the hard-core property of the particles is impor- 
tant and the bosonic approach fails. In response to these 
challenges, there have been many attempts to take the 
hard-core property into account. Brunei et al. [T^ and 
Bares and Mobilia ||l^] formulated fermionic field theories 
for a single-species reaction-diffusion process confined to 
one space dimension. However, these fermionic field the- 
ories are very hard to extend in practice to higher spatial 
dimensions or to multispecies processes. 

We have focused on the extensibility of the field the- 
ory to multispecies processes and to higher spatial di- 
mensions including the hard-core exclusion property of 
particles. In this paper, we present a systematic for- 
malism to derive the field theory for hard-core particles 
and apply this method to a two-species driven reaction- 
diffusion (DRD) system in arbitrary spatial dimension. 
In the two-species DRD system, each particle attempts 
moves to the right and to the left with different hopping 
rates, and the attempt is successful only if the particle 
lands on an unoccupied site. If the particle lands on a 
site occupied by a same-species particle, the hopping at- 
tempt is rejected, but if it lands on a site occupied by an 
opposite-species particle, the A -I- i? — > reaction occurs 
and both particles disappear. For this system, one might 
expect the long-time kinetics to be the same as that of 
A -I- B — > with isotropic diffusion, by a Galilean trans- 
formation, and the density should decay in time as t~'^^^ 
for d < A and as t^^ for d > 4. However, some extensive 
numerical simulations by Janowsky |^ and Ispolatov et 
al. [|l^ indicate that the density decays as t~^^^ asymp- 
totically in one dimension, and others by ben-Avraham 
et al. are inconclusive concerning the exponent of the 
density decay. Consequently, to study this system ana- 



1 



lytically, the hard-core property of the particles should 
be incorporated properly into the field theory. Our gen- 
eral formalism provides a systematic method to derive 
the field theory for this system and with the application 
of the renormalization group derives the long-time be- 
havior as predicted by Janowsky and Ispolatov et al. for 
density decay as t~^/^ in one dimension. 

In general, the dynamics of a stochastic particle sys- 
tem is described by a master equation governing the time 
evolution of the probability P{C;t) for the system to be 
in a given microscopic configuration C at time t. For 
a multispecies reaction-diffusion system with hard-core 
particles, the microscopic configuration C is represented 
by the set of the particle numbers of each species at each 
lattice site; C = {nf} where the greek index a stands for 
the particle species, the latin index i runs over all lattice 
sites in arbitrary spatial dimension, and nf is restricted 
to or 1. Introducing the annihilation and creation op- 
erators satisfying the mixed commutation relations 



a, a; 



/3 



af^aft = 0, 



(1) 



a 



af ] = for i ^ i, (2) 



and defining the state vector \'i>;t) = J2c -^(^■•^)\^)' 
master equation can be written as a Schrodinger-like 
equation |15|, 



(3) 



where Ti. is an evolution operator, often called a Hamilto- 
nian, expressed in terms of a's and a^'s. The formal solu- 
tion for the initial condition |5';0) is, straightforwardly. 



^;0}, and the average of any quantity / 



may be expressed as 

{fit)} ^ J2 f{{nn)PiMht) = (■|/e-«*|vE';0), (4) 

{"?} 

where (-j is the projection state defined as the sum of all 
possible microscopic states, i.e., {■] = X]{n°}({'^f }l- 
a given observable f{{nf}), we find the corresponding 
operator / by replacing the variables nf by the operator 
af^af. In what follows, we shall be mainly interested in 
averages of particle numbers(/ = af^'af) at site i and 
their two-point correlation functions (/ = af^afaj^Uj). 
The time derivative of Eq. is formally found to be 



dt 



{.nt)) = -{-\fH\^)t = {[nJ]), 



(5) 



where we used the probability conservation condition 
= 0. Since the Hamiltonian describes a stochas- 
tic process, in general H is not Hermitian. Thus, [H, f] 
will have creation and annihilation operators that do not 



form number operators. However, the projection state 
(•| acting on [H, f] makes it possible to express the right- 
hand side of Eq. (|^) only with number operators. Using 
the identity from the property of the projection state |lq ] 



(6) 



for any (3, we eliminate all the creation operators in Eq. 
(^) , and any annihilation operator can be interpreted as a 
number operator because ('laf^af = (-1(1 — J2a'^f)'^i ~ 
(•I«f. 

Since the Kramers-Moyal coefficients C" , C"j^ in the 
Fokker-Planck equation 

^--a^[cf({rf)Pl + 5^|cf(W)Pi (7) 

are related to the time evolution of the one-point and 
two-point correlation functions of the number operator 

j^ip?) = (CD, j^{p?P^) = {p?c^ + P^cr + cf), 

(8) 

we find the Kramers-Moyal coefficients in terms of the 
annihilation and creation operators ]l6[ | 

(Cr) - {[n,afaf]), {Ctf) = {[at^af, [H,af af]]), 

(9) 

by interpreting the number operator as a density of par- 
ticles. 

Next we consider how we write down the stochastic 
differential equation when the Fokker-Planck equation is 
known. Recalling the reverse problem, a stochastic dif- 
ferential equation 



Pt^hf{{p})+gtf{{p})e{t) 



(10) 



with {if{t)q{t')) = S°'I^S,j6{t - t') can be connected to 
the Fokker-Planck equation with the coefficient functions 
Cf ({p}) = hf and Cf{{p}) = gf,^g^^ in the Ito inter- 
pretation p7[ |. 

Representing the stochastic differential equation in the 
path-integral formulation, the generating functional Z of 
correlation functions can be written as Z = J DpDpe^^ 
with the action 

Jdt (^Mt){^tP^{t) ~ Q) - \p^(typ,{t)C,^ . (11) 

The response field p has been introduced as the conjugate 
field to the Langevin force. After performing a suitable 
continuum limit for the action, we obtain the continuum 
field description for microscopic discrete models. Thus, 
by mapping the stochastic differential equation derived 
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from the Fokker-Planck equation into the path-integral 
formahsm, we obtain a field-theoretic action describing 
the stochastic process, which in turn may be examined 
by RG analysis. 

Now we apply our formalism to reaction-diffusion sys- 
tems. As the paradigmatic example, we consider the 
asymmetric diffusion process with A + B 9 reaction in 
d-dimensional space. The diffusion constant for an A [B) 
particle is {D^) and along the direction of the driv- 
ing force (say, the "parallel" direction) the diffusion is 
asymmetric with the drift rate va/"^ (vb/^) for an A (B) 
particle. The reaction occurs with rate X/2d when two 
different species occupy the nearest neighbor sites in a 
d dimensional hypercubic lattice. The Hamiltonian gen- 
erating the time evolution of the system is found to be 

= [^f + ^ff ' + T^n] with (e* is the unit vector 
along the direction i) 



T-/dif 



a 

J2 [d^ ("sat+e. + 4an+e.) 



T_/dr 



— I &-f?6t , - — h^-bf^^p.. 

2 y n+ey 71 ^+^\\ 

A 



(12) 



where we left out the diagonal terms because they give 
no contribution to the commutation relations. Following 
the steps given above, we find the field-theoretic action 
for the system after taking the continuum limit. 



S 



J dtdx{h{dt ~ D'^V'^)a + h{dt - D^V^)h 



— 2vAa{pm — a — b)d\\a — 2vBb{pm — a — ^)d\\b 
+ M^{Vhfa{pm -a-b) + M^{Vbfb{p^ - a - b) 
A 



2{a + b) ~ [d + by 



ab , 



(13) 



in terms of the density fields (a, b) of each species and 
the conjugate response fields (a, &). The hard-core prop- 
erty of particles is manifest in the action and pm is the 
density cutoff due to the hard-core property. Since the 
densities are restricted to a, 6 > 0, we shift the fields by 



a 



2a - Pm, P = 2b - pr, 



1, and /3 = & — 1, 



order to apply a perturbative RG analysis. Skipping all 
the irrelevant terms, we get the reduced action 

S = j dtdx{^{dt - D\7^)a + (i{dt - DV'^)(i 



(a + ;5)2-f2(5 + /3) (p„ + a)(p™+/?) (14) 



in the case of = = D, va = w_b = v, and M"^ = 
MB ^ M with D{M)\7^ = £i||(A/||)V| + D^{M^)V\. 
From power counting with shifted fields, we find the up- 
per critical dimension dc = 2. The scaling dimension of 
the coupling constant v indicates that the drift term is ef- 
fective only for fewer than two dimensions, and for d > 2 
the action becomes equivalent to the action derived by 
Lee and Cardy using the bosonic approach for the sym- 
metric reaction-diffusion system A+B ^ 9 without drift. 

We use the Wilson RG method to analyze the long- 
time kinetics of the action. The ffow equations in d = 
2 — e dimensions, to one loop-order, are 



dD^ 

~ir 

dD\\ 
"df 

dMn 



= {z- 2)D, 
= (z - 2)D. 



dMj 

~dr 



= {z-2)M^, 



Mil 



dl 
dX 



(z - 2)M[| + ^ ( 3- 



iz-d)X + 



16 V ^11 
A^ _ 
47ryiJp5I' dl 



(15) 



dv 



z-1 



where g = v'^ / An D^^^^ D^'^ . The Feynman diagrams that 
contribute to these equations are shown in Figs. |^ and |^. 

FIG. 1. The one-loop diagrams contributing to the renor- 
malization of (left) and (right) My. The legs with the 
outgoing arrow are for the response fields (a, /3) and the legs 
with the incoming arrow for the density fields {a, (3). The bar 
denotes spatical differentiation and the dot an Al vertex. 






FIG. 2. The one-loop diagrams contributing to the renor- 
malization of v. These two diagrams cancel each other. 

The dynamical exponent is given by z = 2, leaving D± 
and M± unchanged under the RG flow. The flow equa- 
tions for Z)|| and My have the same contribution and the 
ratio L'li/Mii remains constant (= 1). The reaction rate 
A is renormalized only by the A terms, not the drift term. 
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Combining the flow equations for D±, Dy, and v, we find 
the flow equation for the expansion parameter g: 



ding ,^ ,^ 3 

= (2 - d) - -g. 

dl ^ ' 



(16) 



For d > df. — 2 we find an infrared stable fixed point 
g* = 0, and in a region of attraction, and M|| remain 
constant. The scaling form of the average concentration 
of A and B particles [c{t) = CA{t) = csit)] 



c(t) 



8TT^D\\{£y/^D±{e)(d-i)/H{iYr^ 



1/2 



, (17) 



gives c{t) ^ t '^/^ using the time flow equation t{t} = 

te Jo ^(^)''^_ Below the critical dimension dc, there ex- 
ists a nontrivial infrared stable fixed point at g* — |e, 
and near this point and Af|| flow as e^^^l'^ . Thus, the 
average concentration behaves as 



(18) 



In summary, we have presented a systematic formalism 
to derive the field-theoretic action for systems of hard- 
core particles. Starting from the master equation for a 
stochastic process of the system, we have constructed 
the Fokker- Planck equation by introducing annihilation 
and creation operators with mixed commutation rela- 
tions. This Fokker-Planck equation is connected to the 
stochastic differential equation by identifying the coef- 
ficient functions in the Ito interpretation. Finally, the 
stochastic differential equation is mapped onto field the- 
ory using the path integral, giving the field-theoretic ac- 
tion to be analyzed by the RG method. 

Although there have been many attempts to incorpo- 
rate the hard-core property of particles into field theory, 
our formalism has a very important advantage over other 
attempts. Our formalism can be applied to multispecies 
systems in arbitrary spatial dimension. As a paradig- 
matic example, we have applied our formalism to the 
A -I- i? — > reaction-diffusion system with drift. Follow- 
ing straightforward steps to obtain the action and apply- 
ing the momentum-shell RG method, we have calculated 
the long-time behavior for the average concentration of 
particles. Power counting shows that the upper critical 
dimension is dc = 2, and the drift term affects the RG 
flow only for fewer than two dimensions. Thus, for d > 2, 
the hard-core action behaves the same as the bosonic ac- 
tion derived by Lee and Cardy. The average concentra- 
tion behaves as for d > 4 and t~'^l'^ for 4 > d > 2 
in the long-time limits. Below the critical dimension, the 
drift term moves the stable fixed point to the non-trivial 
one and the average concentration behaves as 



for d < 2. These results agree with the simulation results 
by Janowsky |^ and the scaling arguments by Ispolatov 
tt al 0. 

As mentioned before, our formalism has merit in ex- 
tension to multispecies and to higher spatial dimensions. 
Also, it is necessary to use this formalism, not the bosonic 
formalism, when the system has nonvanishing concentra- 
tions in the steady states. The three-species reaction- 
diffusion system and some other systems having non- 
vanishing steady states are under investigation using this 
formalism. 
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